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: Assessing the English Speaking SkilIs of 
te Bilinguak Children 


_ The ieee ddcade has seen'many changes in approaches to classify- 
dag sefoal children for instructidhal purposes. Intelligence tests 
have. been subjected to careful scrutiny by well-trained bilinguals 
(De Avila, 1972) and have even been eliminated from test batteries in 


many school districts (Bordie, 1970). School personnel have come to 


. 
-* 


+ sort ott cultural differences in children from cultural defi¢its 


a ip 
+ 


(Bruck, 1972).° Tonuvative researchers like Jena Heceds haye éven 
provided the assessment field aie instruments for distinguishing 
socdoculeucal difference from mental retardation (Mercer, 1975; 
,  Soeffing, 1975). , 
This paper will ‘focus exclusively on the bilingual child who ‘is 
dominant in a language oe than English and who has a sociocultural 
background different from that of the majority group. The paper will 
‘also restrict itself to‘ways in which an applied {itieutet might assess 
English speaking skills among such children. * 
In my own pediaivton of bylingual programs over the years, I 
have noted that some bilingual children learn to speak English 
quickly and stiectively; while others take more time and experience 
diffiéulties. In other words, sociocultural difference and nmon- 
English language background have differential effects on the acquisi- 
tion of English-speaking skills among bilingual children. What are 


some of the reasons for these differences? Clearly, intelligence may 


have something to do with differences in votabulary acquisition and 


A 


- retention among bilingual children. But there are a number of other 
factors which are recently gaining greater visibility in the literature. 


Such factors include not only linguistic strategies for communication, 


3 


‘ 


but cognitive style, personality, and attitudinal factors as Wet. * 
With regard to linguistic factors manifested in speech, bilingual * 

children employ strategies for simplifying the communication task -- 

strategies often resulting in deviant forms. Such strategies include 


negative transfer (or interference) from the native language and over- 


generalization within the target langiage. The student may a i 


. i] . 
utilize types of avoidance of forms or rules that he does not have 


mastery over, through paraphrase, topic avoidance, appead to authority, 


~~ 


end ’o forth (Tarone, Cones, Dumas, 1976). Such avoidance may or may 
not result in grammatical errors or inappropriate utterances, given 
the particular context. It may be that some of these linguistic 
devices are used more frequently by more successful eiasiasee though -: 
this is still very much a research question. For example, research. 


may show that an increase in overgeneralization type-errors and a 
, d 


decrease in negative transfer errors indicates progress in the acqui- 


i~ 


sition of speaking skills (Cohen, 1976). 


Cognitive style variables may, in fact, be closély linked to lin- 


° ‘ 
guistic factors. For\ example, cognitive measur¢s such as word-color 
‘ é ’ { 
’ 
discrimination tests measuring general i ale ca and category- 
width tests measuring skill at categorization of generalization may 


ultimately help predict ease at learning to spedk a second language 


(Naiman, Frohlich, & Stern, 1975). The dimension of field independence 

has also been related to language learning in that the field independence 
« 

learner may, in fact, pay more ae to relevant language details 


without being distracted by irre} vant ones (Cohen, 1976). Such dimen-~ 


, 


sions may ultimately provide diagnostic information about language learners 


that language aptitude tests have not provided. ” 7 


Personality Variables may also influence speaking skills. For 
« 


: i 
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. = | NX 
example,, speaking fluency’ has been linked to extroversion among 
Chicano high school students in Lo& Angeles (Rossier, 1975). Further- 
é z more, Tucker, Hamayan, & Genesee (1975) found that a four-trait factor 
comprising assertiveness, emotional stability, adventuresomeness, and ° 
conscientiousness related to success in speaking French among students 


° ‘ 
in a late (grade 7) French immersion program in| Canada. 


‘ 


With respect to attitudinal variables, Naiman et al. (1975) suggest 
that the way in which the learner perceives his individual learning F 
situation (e.g., the classroom) is more predictive of success than, 
say, itapeative (social) or instrumental (economic) motivation, two 
of Gardner & Lasbext's (1972) principal attitudinal variables. Their 
conclusions were based both on content analysis of interyiaws with 
language learners and on statistical correlations between attitudinal 
variables and achievement. 

An enlightened assessment of speaking involves: (1) an aware of ~ 1 
how respondents' characteristics match the selected instrument (s) 
and administration procedures, and (2) a well-thought-out plan for 
scoring, interpreting, and using the results. These considerations 
have already received ‘onuiderebic attention in the literature, so 


in this paper I will refer to some of the relevant articles only in 


passing. fe 


-With respect to instrumentation, any instrument is but one way 
of getting at the reality -- in this case, the child's English-speaking 


' skills. Kenneth Goodman cautions against "reification" and "reductionism." 


/Reification implies that a measure of some construct (e.g., speaking 


1. Remarks presented at the Bilingual Evaluation Seminar, spon 
sored by the Illinois Downstate Bilingual Evaluation, Chicago, March 
“ 25-26, 1976. 4 


skills) begins to be equated with the construct itself, both by the 


test constructors and by users. Reductionism/implies reducing a con- 
e! . - . 3 , 3 Z 
struct such as English speaking to one single test scorp. Thus, the 
x 


evaluator sKould be entirely aware of both the explicit and implicit 


assumptions underlying the instrament. 
/ 


4 


The literature has referred to linguistic, cognitive styleyand 
sociocultyral mismatches between what the test ptaaunniees about the 
respondents and what the Siitneval minority child actually brings. to 
the/test. The linguistic content of the test may inadvertently pe- 

6 rare the eenistlve speaker (Fishman et al., 1967; \Kennedy/ 1972; 
/ oP e 

De Avila, 1972; Hickey, 1972; Briere, 1973; Cohen, 19758), ven _ 

translations (rather than parallel jeraions) pf Linetie ts} in the 

learner's native language may penalize the bilingual ee to the 


extent that the level of grammatical and lexical difficulty and fre- 


quency of words are different in the learner's natiye-language form. . 


Measures designed: for Anglo middle-class snore may also cater 
- XN 


to certain cognitive styles. For example, field dependence|as dis- 


, / | 


cusped above has been identified as more prevalent among lower- 
class Mexican Américan children than: among middle-class Anglos 


r) 


Ly, 4 
(Ramirez & Castajieda, 1975).° Rosalie Cohen (1969) has defined rela- 


tional and analytic styles and has identified:them with lower- and 


middle-class learners respectively. 
The literature also calls ample attention to the lack of ‘E 
ey 
between the sociocultural content of an assessment instrument and 


the sociocultural background of the respondent (see, for example, 


Fishman et al., 1967; Ervin-Tripp, 1971; De Avila, 1972; Briere, 


c : . ohen 


7 


‘ a ‘ j 3 . v . 
“1973; Cicourel £1974; fercer, 19/5; Soeffing, 1975;-Condon, 1975; Cohen, 


1975»). 


‘ . 


With regard to‘ administering a measure of speaking skill, there is 


the problem of matching up the tester's expectations and (possibly) * 
a 
‘ his, ethnicity to she pa, Sena and test-taking know how ‘ 


rae (Schroeder & Kleinsasser, 1972}. lehan, 1974; Cohen, [975ay, partic-) 


ularly in more formal test-taking ‘ituations. The danguage of test 


° ‘administration also may affect’ he dutcones ~~ e.e.; the choice of 


‘ 


* languages and the actual structurés used (Kennedy, 1970; Gotan, 1975). 


‘ 


Especially in the case af individually~administered tests ‘stich as the ° é 


WISC, the tester must interpret the child's behavior. Ag Mehan (1974) 


‘ t 
put it, \"The interrogator and respondent work together to jointly com~ 


pose the ‘social fact" we call an answer-to-h-question"- (P. 44). This 


delicate interaction between tester and resfondent can be atfected by 


a multiplicity of factors, not the least of which being how, comfortable 


the respondent feels. Evin rtep a suggests starting « an elici-~ 
* ' 
tation task with aia: stories or other means to’ put the minority ° 
ry 
student at ease. j 
“a '. . 
Language assessment instruments may appear to have no overt lin- 


gu¥stic, cognitive style, or sociocultural biases in them, and may 

? ill fall prey. to criticism for lack of an appropriaté storing system or 
; é : 

an absence of clear-cut guidelines for interpreting and/or using the 

results (Condon, 1975; De Avila, 1972; Cohen, 1975b). An inbtrument 

may have so narrow a ee system that much useful information is 

/ overlooked (c.f. the problem of ‘eeductionion" mentioned above) or so 

broad a system that no ties weer can agree on the outcome. 


One ‘key to interpreting what the results of a measure mean ‘is ii 4 


that of norms. Unfortunately, whére English norms éxist for language 


( 


= eg—eene: 


) 


x 


eS ae: “1 €ohen 6 


»> 
. 


_ tests, such norms may be grossly inappropriate for minority group bi- 


linguals (Bordie, 1970; Hoepfner % Strickland, 1972; De Avila, 1972; 
Briere, 1973). Furthermore, tests supposedly constructed in Spanish and 
English Yor testing bilingual language skills (e. go Elizabeth Carrow's 


' audftory- Comprehension Test and the Canniape subtest of McGraw-Hill" s Test of 


mh 


Basic, i as are generally tacking | norms for the Spanish version: 
With or’ without norms, test results are’ sometimes used in ways that 

the test constructors had not intended. Classifying a"bilingyal as" 

a limited English speaker should be ba retorence either to the spbects 
of other bilinguals of similar’ sociocultural backgrounds .or to the de~ 
veloping (often non-standard) speech ‘of Zovertclass ,Anglé children. 

Largely as a nial: of federal and state bilingudl schooling sis 
grams, teachers and evaluators have started looking for measures of, 
bilingual apeaking skills. Whereas in 1971 there were only a few 
measures on the market, euch as, the Dailey Language Facility Test dar- 
lingeon a a a (see Gohen, 1975a), as of 1976 there are a wide 
range of formal measures and iene formal procedures | for xeceseing 
epaukion skills. Thene approaches differ in a variety of ways: chile | 
speaking to peer vs. child speaking to adult; sttificial hes Be» story 
retelling) vs. naturalistic ‘(student interview) vs. natural (informal 
classroom talk); fixed format oe sentence repetition) 763, bine enced 
format (e.g., structred cue response); test of morphology (inflections) 
vs. test of syntax (sentence structure) vs. test of, EFOOMORIAES CR, etc. 

The following is a brief, non-evaluative Avading of measures wnich ~ 
are illustrative of what is now avatlabie ti? ehedivevastive: both 4 


commer¢ial and non-commercial, for. assessing English speaking skills 


among non-natives: 


_an adult interviewer asks children (K - 2) questions in Spanish and 


‘ 


(1) The Basic Inventory of Natural Language (CHESS & Associates, 
4401 Birch Street, Newport Beach, California 92663) -- an instrument 
which involves’ the training of children (K - 6) to tell. stories $6 their 
peers, in Spanish and in English, thus providing language samples without 
adult intervention. Teachets then analyze ten sequential sentences 


, rca 
from each‘child's data, on the basis of fluency, level of complexity, 


N 


. \ 
(2) The Bilingual Syntax Measure (Harcourt, Brace, Jovanovich) --~ 


and average sentence length: be 


. Epglish about a series of cartoon pictures. ‘The questions are gram- 


4 P . 
matically motivated in that: they ‘are ss as to elicit, among other 


things, verb: tense and aspect, and agreement between noun and deter- 


miners and subject and verb. ~ : Fe 


' 


. ; ~ 2 
(3) The Short Test of Linguistic Skills (Multilingual Unit, De- 
. ‘ , . 
partment of Research and Evaluation, Chicago Board of Education, 
2021 N. Burling ‘Street, Chicago, Illindis 60614) -- the speaking 


r* i 
subtest has 20 items eliciting from children (grades 3-8) structured ~~ « 


=, 


conversational responses, structured cue responses, free conversational ‘ 


responses, and free cue responses (based ‘on a picture).* English and 
_ e 


native language parallel forms exist in 11 languages. The two r 


forms ate separate tests -- not translation equivalents -- with 
dulturnlly-tetevant pictures and kaneenk( | : 
( . (4) MAT-SEA-CAL Oral Proficiency Tests (English, Spanish, and 

other languages) (Seattle Public Schools, & Center for Applied Linguis- 
tics, 1611 N, Kent Street, Arlington, Virginia 22209) -- the speaking — 


subtests for children (K - 4) include sentence repetition and cued 


« ~ ¥ 4. , 
structured response (e.g., "WRat's the little girledoing? She's ... ‘ 


', buyitfg an ice cream cone"), 4 


4 


. 7 « : ‘ . By +d ' . ae, 
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(5) Staged communicative tasks -- e.g., the respondent assumes 


‘the role of interviewer of a supposed tonelingual “speaker of the target 


language (Powell, 1975). 
° (6) Unstaged communication -- videotapitig of péer interactions, 


using 4 wireless microphone (Brown, Bruck, Shultz, &Walcer, 1976). 


. . ? 
Thus, we have an array of different instruments and the literature 


provides us insights as‘to how to assess the assessment instruments. 
; ‘ : ’ uy # 
What do we do now? Here are some Suggestions: 


4 : 
-—An éclectic approach whereby several different measures are, 


used, may provide a closer estimate of a child's English speaking ¢ 


. ‘ 
skills than one measure alone. - 


(2) The measures should be able to pass initial ‘screening with 


respect to sociocultural and lirfguistic fairness for the learner. If 
: : ; 


: 7 
not, any interpretation of the outcomes should bear this im mind. 
, 


} 4 


(3). Administration rocedures should maximize desired effects 
(positive nofPvation on the a ee part) and minimize unwanted 


ones (e.g., inhibition). . : a 


(4) Scoring may profitably involve both discrete-point scoring _¢ 


(e.g., Short Test of Linguistic Skills) and global scoring (e.g., 

Bilingual Syntax Measure), as well as a blend of quantitative and 
i 

qualitative assessment (i.e., the social facts of the assessment 


context)’. Scores alone may be misleading. As Mehan (1974) notes, 


oo , 
" 
. 
. 
| 


++. to conclude that a wrong answer is due to a lack of understanding 
is misguided, for the answer may come from an alternative, equally 


valid interpretation" (p.28). Although Mehan's remarks were directed 


, 


at multiple choice reading items, the analogy could be made to measures 


ee 


of speaking. In other words, after the test is oveg, the speaker’ 


could become informant in order to help the examiner to better in-- 


ad . . 2 
terpret the results. Such a format is particularly helpful when 


error analysis is performed on the data. For,example, the respondent 


; tod, i 

himself may be able to determine whether a deviation was a result of 
/ . 3: _ 

negdtive transfer from his native language, GRR EEHe NEL SeAG oon of the 


target *EnENAEES or the influence of a nonstandard variety of the © 


~ 


ee (cohen, 1975a; Cohen & Robbins, 1976). 


« et. 


\N Once measures have been selected, administered, scored, _and in- 


terpreted, how might the results be utilized? A sensitive battery of 


| 


* measures might do hore than winply indicate limitations. yt may suggest, . 


teachable activities. perhaps certaih linguistic strategies, cognitive 
patterns, Pantone se goer ere and attitudes can be engendered or 
taught formally. For example, it may be fruitful to teach limited 
speakers to use paraphrase or generalization (analogy) to maintain 


_the flow of speech, to adopt field-independent techniques for 


avoiding distracting stimuli in the field, and to be more self-assertive 


(extroverted). But just what should he taught is in need of more 


extensive empirical evidence. The notion of teaching learners how 


. i 
to learn a language, specifically, to speak it, is an intriguing 
ts, 


{ . 
departure from a previous emphasis on a teachers to teach lan- ' 


oad ‘ 


» guages. 


sn ai 
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